


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1969 


An adaptive decision process. 


Moroney, Joseph Maris 


Monterey, California. U.S. Naval Postgraduate School 


http://ndl.handle.net/10945/11556 


Downloaded from NPS Archive: Calhoun 


| Calhoun is the Naval Postgraduate School's public access digital repository for 
_ (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist iL Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


" \ KNOX appointed — and published -- scholarly author. 
| inp 
, LIBRARY Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 


NPS ARCHIVE 
1969 
MORONEY, J. 


AN ADAPTIVE DECISION PROCESS 


Joseph Maris Moroney 








——» DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CA 93943-5101 


United States 
Naval Postgraduate School 


AN ADAPTIVE DECISION PROCESS 


Joseph Maris Moroney 





December 1969 


This document has been approved for public re- 
Lease and sale; 4ts distribution 4s unlimited. 


T13 


2 ™7 
or 


‘e } 
Se 
ee 
Naor NV 


rae) 


“18 


NAVAL POSTGRADUATES , 


MONTEREY, 


CALIF, 93940 


An Adaptive Decision Process 


by 


Joseph Maris Moroney 
Lieutenant, United States Navy 
B.S.E.E., University of Washington, 1962 


Submitted in partial fulfillment of the 
requirements for the degree of 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
December 1969 


ABSTRACT 


This thesis investigates a decision process which is designed to 
employ multiple observations in an optimal manner as a means of solving 
a signal detection problem. The characteristic of this decision 
process is that it permits the decision-maker to defer his detection 
decision until new data is obtained from the next observation and 
to weigh the new data with an opinion based on previous data. The 
effect of adapting a decision to the results of previous observations 
is seen to be similar to a learning process which is taking place 
over a length of time. Since the decision process may involve 
relatively vengens periods of time an estimator of this time is 
developed. Lastly, the decision model is seen to provide a model by 


which human detection behavior may be evaluated. 
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I. AN.ADAPTIVE DECISION. PROCESS 


An integral part of a signal detection process is the application 
of decision theory methods to the problem of determining whether or 
not the signal of interest is present. The techniques of decision 
theory assist the decision-maker in making a detection decision in 
the presence of random noise, with.minimum error. 

Classical detection is concerned with deciding the presence or 
absence of a useful signal in the presence of random noise after a 
single observation of. fixed length has been made in a signal environ- 
ment. The detection process may be complicated by a requirement to 
detect a signal with. unknown parameters. This thesis will investigate 
a procedure by which multiple observations of a signal environment 
will assist in detecting such a signal. 

The emphasis of this thesis will be on the discussion of a 
decision process which is designed to make use of multiple observa- 
tions and on the application of this decision process to the problem 
of detecting an electromagnetic signal with known characteristics and 
transmitted on an unknown frequency. The decision process by which 
this is accomplished is shown to have optimum properties which may 
be applied to other detection problems involving multiple observations. 

The decision process by which the detection of a signal with an 
unknown parameter is accomplished will be referred to as an adaptive 
decision process. The characteristic of this process is that it 
permits the decision-maker to defer his decision until new data is 
obtained and to weigh the new data with an opinion based on 


previous data. 


Il... STATEMENTSAOR. THESPROBLEM 


The problem which is to be investigated in this thesis is the 
application of an adaptive decision process to detect a useful signal 
in the presence of random noise when a parameter of the signal is 
unknown. The process employs a scanning procedure in which a detec- 
tion device may take repeated "looks'' at a set of locations in 
which the useful signal is suspected to be present. The objective 
of the scanning procedure is to arrive at a state in which the 
unknown parameter is known and the useful signal is detected or 
conversely be in a state in which it is known that the useful signal 
is not present. Further, the decision process has the capability 
to make use of information derived from the preceding k-1l scans 
when the ag scan has been completed. 

The nature of the decision process will require that the useful 
signal have certain minimal characteristics: 

1. The useful signal must exist long enough so that a 
minimal number of scans may be made. (The minimal 
number of scans may be computed; this topic will be 
discussed later.) 

2. An a priori probability can, be,assigned to, the eventethat 
the signal of interest is present in the set of locations 
being scanned. 

3. Only one useful signal is present in the set of locations 


being scanned. 


III. BACKGROUND 


Classical detection theory is concerned with deciding the presence 
or absence of a useful signal in the presence of random noise after a 
single observation of fixed length has been made in a signal environ- 
ment. The goal of this procedure is to make a detection decision 
with minimum error. The detection error is due to the noise which 
tends to mask the useful signal in a random manner. As a result, 
“guessing is required to determine the presence of a useful signal; 
thus one signal may be confused with another or may go entirely 
undetected. The random nature of the background noise and the 
dependence of the useful signal on random parameters suggests 
decision theory methods should be employed in resolving the detec- 


tion problem. 


A. DECISION RULES 

The decision theory approach to the detection problem begins 
with the formulation of the input to the detection process as the 
union of the useful signal m(t) and the noise n(t) , given 
as functions of time, 

TiGe a miccy + a(L) 

Next, it is necessary to compute the a posteriori probability 
that the signal m(t) is present in the received function 
f(t) = m(t) + n(t). 

The a posteriori probability P(m| £) that the useful signal m(t) 


is present, given an input signal f(t), can be expressed as 


P(m)P(£|m) 


P(m|£) = P(£) 


Further, f(t) is a compound event so P(f) may be expressed as 
P(f) = P(m)P(£|m) + P(n)P(£ |n) , and 
P(m) + P(n) = 1 , where 
P(m) is the a priori probability that the useful signal is present 
and P(n) is the a priori probability that the useful signal is 


absent. After substituting for P(f) we have 


P(m|£) = Eile) Eatin a ee 
- P(m)P(£/m) + P(n)P(f/[n)  L + [P(n)/P(m)] 


The quantity L is the likelihood ratio and is defined as 
L = P(f£|m) 
Paa(ut. |r.) 
The a posteriori probability that the useful signal is absent may 


be expressed as 


P(n)/P (m) 


Paalf) = TS Ppa /P@l 


Lastly, the ratio of the a posteriori probabilities equals 


Pane E (im ) L 
P(n|£) + P(n) 


Next, on the basis of the input signal received by the detector 





and its likelihood ratio (L), a signal detection decision may be made 
according to a decision rule, such as the following rule, 


# 
If L2 L_s, the signal is present; 
+ 


If L, < L “90 {ne deeteion tsemade;, 


If Ls L, , the signal is absent. 


Ps 
The terms L and L are referred to as thresholds; their values 


# 
are determined by the detection error which is allowable in the detec- 
tion process. This decision rule will be of interest in later 


discussions. This decision process is called a sequential process 


because of the manner in which input data is handled. For each 


Observation, of a signal environment for example, a likelihood ratio 
(L) is computed in the manner described above; this L is compared 


a * 
tome: anda Leeman Sod. no detection decision is made 


* 
and another observation is made. This process continues until L 


* 
exceeds L, or L . It is well known that with probability l 


* 
the sequential process will stop after a finite number of observations 
et which time the thecshold ly or L will have been reached. 

In previous discussion of the detection process, it was noted 
that the random effects of the noise portion of the input signal 
could cause errors in the detection decision. Two kinds of errors 
are possible: 

1. The false alarm error which results from interpreting 
noise to be the sum of signal and noise; the false alarm 
probability is denoted by F. 

2. The false dismissal error which results from interpreting 

the sum of signal plus noise to be just noise; the false 
dismissal probability is denoted by 1-D, where D is the 


probability of a correct detection. 


& 
The values of the thresholds L and i” will be defined as 


ro 
* 1-D 
L = lor? and 
be = F/D . 


Lastly, if the concept of costs of errors is considered, the 
optimum decision rule is the rule with the smallest cost. Let Ci_p 
be the cost of a false dismissal and C., be the cost of a false 


alarm; the costs of correct detection and correct dismissal may be 


taken to be zero. If the observer pays the cost corresponding to 


which of the two errors occurred his expected loss or risk is 


Risk = P(m) (1-D)C,_) + P(n)FC,, ; 


B. ADAPTIVE DECISION PROCESS 

A large number of detection problems exist in which the detection 
decision process is complicated by the requirement to detect the 
srenenee of a useful signal which has unknown parameters. Fralick 
[1] proposes an adaptive decision process to handle this type of 
detection problem. 

The adaptive decision process employs a decision rule which 
allows the decision maker to defer a detection decision in a manner 
somewhat similar to that discussed in the sequential decision process. 
The primary difference is that the adaptive decision process accumu- 
om: information through a recursive process in which the detector 
might be considered to learn the nature of the unknown parameter; 
the sequential decision process merely takes another independent 
observation then computes and compares a new likelihood ratio, 


based on that observation, to the thresholds. 


IV. ADAPTIVE. DECISION. PROCESS MODEL 


For convenience, the input to the detector in this model will 


be denoted by the symbol f (t) “as a way of indicating this 


k+l 
particular input is being considered during the interval 
les. tas(eti) Tt. 


From development of a likelihood ratio in preceding discussion, 


we may state that 


” P(f.4,/m) 


Tae e Een in 


10 


Now let the useful signal have an unknown parameter T which is to be 


measured; i.e... m(t) =m(t,T) and T varies continuously. Then 


b 


from the following likelihood relations, where P(T) is the a priori 
probability that T is present, 


P(E 4 17) 
Ae MD) y= P(e Ta) and Lm.) = [La |t)dT , 


we get, after substituting where appropriate, that 


’ [BGs ee DR Gock 


L(fiaa) * P(E yim) 


When the input signal f is being examined by the detector, the 


k+1 


signals f i f have already been examined. We desire to 


p> For cers FL 
make use of the results of those examinations and to do so in an opti- 
mum manner. The Bayes optimum way to use the prior inputs £i>f,,---.f) 4 


is to compute a likelihood ratio based on these prior inputs, 
Lf, Gaon: een = PCE |T)P Cie seme, aT 


where any fii < k, may or may not have had a useful signal component 
m(t,T). Fralick [1] shows that a recursive relationship may be derived 


for P(t). In Appendix A it is shown that PL (T) is related to 


Pi (7) by the following recursive relationship, 
P.(T) =P (ae i Cyglltidhesie Og where o = oie I) 
k k-1 Ly (f,) + aq” P(T) : 


P(T) is the a priori probability that the parameter T is present. 
This recursive relation may be considered to be the result of a 


(T) 


delay-feedback loop or learning loop in which the value Pred 
serves as a memory of past observations. A diagram of the informa- 


tion flow which creates this loop is shown in Figure l. 
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The operation of the physical realization of the adaptive decision 
process is straightforward. 

1. The input to the process is obtained from a likelihood 
ratio computer capable of providing L(£,|T) for each 
possible value of T in the range being scanned. 

2. The values of P16?) for each value of T are computed 
in the learning loop. The learning loop is initialized 
with a value Pot), the a priori probability that a 
signal with the parameter is present when the detection 
process is started. 

3. As the values of [L(£, |T) +a] and P 7 6?) become 
available, they are multiplied and the product then 
integrated. 


4. Once each T_ seconds T) is sampled and compared 


ser 
against the threshold to determine if the useful signal 
is present or not. 

Fralick [1] discusses the application of an adaptive decision 
process to the design of a radio receiver for use in locating electro- 
magnetic signals with known amplitude and phase characteristics which 
are transmitted (for long periods of time) on an unknown frequency. 
Typical results were that the signal was identified by the receiver 
in ten sweeps across a frequency band in which the signal was known 
to be located with a signal-to-noise ratio of -1l dB and 100 sweeps 
when the signal-to-noise ratio was lowered to -1/7 dB. It is noted 
that the unique signal of interest must be on the air for a length of 
time sufficiently long to allow multiple looks throughout the frequency 
band being investigated and further that the receiver model is respon- 


sive to only one useful signal in the frequency band being scanned. 
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V. OPTIMUM CHARACTERISTICS OF THE ADAPTIVE PROCESS 


Wainstein and Zubakov [2, sec. 57] discuss the problem of detecting 
a signal with an unknown parameter and combining measurement of the 
parameter with detection. They view the problem as one which is re- 
solved by using multichannel receivers (detectors); i.e., the band of 
frequencies containing the carrier frequency of an electromagnetic 
signal in this case may be quantized and each channel tuned to a 
separate portion of the frequency band. Multichannel receivers may 
be divided into three catgories depending on how the detection and 
measurement process is performed: 

1. Type I receiver first carries out detection and then 
measures the parameter. 

2. Type II receiver carries out detection and measurement 
in parallel. 

3. Type III receiver first measures the parameter, 
expressed as a likelihood ratio, and then uses the like- 
lihood ratio to verify the presence of a signal with 
the measured parameter. 

The multichannel Type I receiver is claimed by Wainstein and 
Zubakov [2] to be the optimum receiver for detection; it is optimum 
in the sense that it has minimum risk associated with the cost of 
decision errors. Fralick [1] shows that an adaptive (or learning) 
process may be employed on the multichannel Type I receiver provided 
the prior probabilities, that the parameter of interest is on a 
particular channel, are independent. The learning process updates 


these probabilities on each channel in the recursive fashion 
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previously described; i.e. the value of P (T) is modified. When 


k-1 
learning is completed, all the channel probabilities will have gone to 
zero except for the channel that contains the parameter of interest; 
that channel will have a value of Pi) > Q. The effect of the 
recursive updating is to adapt the multichannel Type I receiver to 
what is effectively a single-channel receiver. 

If the input to the detection system can be scanned serially, 
one single-channel learning receiver may be used as a detection 
receiver instead of the multichannel receiver which operates in a 
parallel scanning mode. As has been noted previously, this restricts 
the application of the learning process to a single event which occurs 


frequently in the interval we can observe or which is present long 


enough to be scanned. 


VI. MEASURES.OF. EFFECTIVENESS 


The detector (receiver) which employs learning on serially 
inputed data has, initially, a detection and measurement performance 
capability equivalent to the Type I multichannel receiver as 
described previously. As the detector adapts to the parameter of 
interest through its recursive learning process, its performance is 
approaching, and finally reaches, that of a single-channel narrow- 
band receiver; which has the same effect in improving signal detection 
capability as would an increase in the sensitivity of each channel of 
the multichannel receiver. With an adaptive detector a lower signal- 
to-noise ratio (yu) is thus required to achieve given values of correct 
detection probability (D) and false alarm probability (F) than would 


be required with a multichannel receiver with the same sensitivity. 


15 


Wainstein and Zubakov [2, p. 299] show that for given values of F 
and D, where F is small, the threshold signal-to-noise ratio for 


a multichannel receiver with M channels is 


ine + 1lnM 
a i ae, 


u 
M 1 
Ins 


For a single-channel narrow band receiver such as the learning 
receiver working on serially inputed data, the threshold signal-to- 
noise ratio required to achieve the same level of detection 


probability and false alarm probability is, 


The ratio Maye may be used as a measure of the improvement in 
sensitivity which would be expected when a recursive learning device 
is being considered as a substitute for a multichannel device with- 
out the learning feature. 

The time that is required for the adaptive detector to make the 
transition from a device with a multichannel capability to a device 
with single-channel characteristics is a second measure of effec- 
tiveness. Fralick, et. al., [1] used simulation techniques to 
determine the transition time for various signal-to-noise ratios; 
the observation was made that closed-form expressions for the 
transition times were not known. 

Wainstein and Zubakov [2, p. 361] note that for the situation 
when F and D are specified and the observation time is left as 
a random variable, the optimum decision rule is the Wald sequential 


x 
probability ratio test (SPRT) with the thresholds L and L, 
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given by the formulas 


* 1-D 
L = ae and 
F 
L. = 5 


Recall from previous discussion that 
uw, inD = Ins A 
where Wo is the threshold signal-to-noise ratio for a given F 
and D, when F is small. In view of the relation of the ratio 
F/D to both the lower threshold of the SPRT and to Mas it is 
proposed that the characteristics of the expected number of 
observations made in a SPRT, before a decision is reached, be used 


to develop a measure of the transition time for an adaptive detector 


to attain the level of performance of a single-channel receiver. 


VII. DETERMINATION OF TRANSITION TIME 


The proposed use of the expected number of observations made in 
a SPRT as a means of estimating transition time is based on the 
similarity between the SPRT and the adaptive decision process. First, 
there is the relation of the ratio F/D to both the lower threshold 
of the SPRT and to Uy: Second, there is the quantitative demon- 
stration in [1] that the adaptive decision process terminates in a 
finite number of observations provided the threshold We is exceeded 
by the useful signal; it is well known that the SPRT, with probabil- 
ity 1, will yield a decision after a finite number of observations. 

Based on this tenuous similarity between the thresholds and 


observation characteristics of two decision processes, the expected 


transition time which will be developed here is only a weak estimate 


WW 


of the true expected transition time. It is strongly suspected, 
though, that it will be a conservative estimate in that it will 
overestimate the transition times. 

Following Sverdrup [3], the derivation of the expected number 
of observations in a SPRT is developed in Appendix B. From that 


development we get the expected number of observations E(N) to be 


Din : (1-D) In 

E(N) = = where 
(£ |m) 

Z 1 Ga) and Z # 0 


VIII. COMPUTATION OF E(N) 


As an example of the procedure for determining the expected 
number of observations, E(N) in a signal detection problem, we 
will apply the relation derived in Appendix B to the adaptive 
receiver process described in [1] and compute the number of ob- 
servations which would be expected for the receiver parameters 
described in [1]. 

The adaptive receiver described in [1] operated with a false 
alarm probability F = figs and a correct detection probability 
D= 0.5. The adaptive receiver was used to determine the frequency 
of a sinusoidal signal with known parameters of amplitude and phase. 
Wainstein and Zubakov [2, p. 174] show that the likelihood ratio 
relating to this set of conditions has the form, 

(flees g2 
g(f[n) Itu~ Pi20+p| » 


; : ' al 
where u is the effective signal-to-noise ratio and Q is a 


parameter which describes the envelope of the signal of interest. 
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After taking the natural logarithm of the likelihood ratio we get 


Z 
aw) eae + 


En Cr n) 1+ u 2(1+ u) ; 


which has an expected value, 


2 
nae ae me 
E(Z) = ins + zakss) 


Evaluation of Heoss2aa ie) could be quite difficult if the 
exact nature of the envelope (Q) were not known; substitution 
eliminates this problem. Wainstein and Zubakov [2, p. 176] discuss 


i : we. 
the use of the parameter Q in a simple detection decision rule: 


igi Q° > Qt , decide that f(t) = m(t) + nt; 
lie Q° 08 , decide that f(t) = n(t), 
where Qi is the decision threshold. This threshold .3 shown in [2] 


to be related to the probability of detection (D) in the following 


2 
P= exp Ty dey) 


After taking the natural logarithm of this expression we have the 


manner, 


following relation between D_ and Qt , 


Qf 


A cea) 
2 Zz ; 
Now, Q must be at least equal to Q, , if not greater than 
Q? » in order to make the decision that f(t) =m(t) + n(t). We 
may therefore substitute Qi for Q” in the expression for E(Z) 


on the assumption that the signal of interest, m(t), is present. 


After this substitution, we then have 





E(Z) = ln - yu lnD. 


di 
1+ u 


he, 


With this result, the expected number of observations to be made 
by the adaptive receiver in order to detect the signal of interest 


is seen to be 





Din - ~ (enya — 
=. 
ln ez, - ulnD 


If the operating parameters, D= 0.5 and F = i. Os » are 
substituted into the formula for E(N), we find that approximately 
Teo cee are expected at a signal-to-noise level of -1ll dB 
(u = 0.08) and approximately 600 observations are expected at a 
Signal-to noise level of -17 dB (up = 0.02). As was anticipated, 
these numbers are significantly greater than the actual numbers ai 
observations needed to detect the signal of interest as reported by 
Fralick et. al. [1]. The disparity between the computed number of 
expected observations and the actual results reported in [1] is 
assumed to be influenced by two characteristics of the adaptive 
decision process: 

1. <A strong a priori opinion that the signal of interest 
will in fact be scanned (i.e. a value of P (7) = 0.75 
for example) would be a factor in reducing the number 
of scans. Loosely speaking, the recursive effect of the 
likelihood ratios would bring the value of P.(T) to 
the acceptance threshold with fewer scans with a larger 
starting value of Pi?) than with a small value of 
PT); provided, of course, the signal is in fact there. 
If the signal is not present, a strong a priori opinion 
that it is present would be expected to require more 


scans to determine that it, in fact, is not present. 
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In the results described in [1] the signal of interest 
was always present; the value of Pf?) used in the 
receiver was not reported. The SPRT is not influenced 
by any a priori opinion regarding the state of the set 
of signals being scanned; the same number of scans would 
be expected whether the signal was present or not. 

The adaptive decision process is designed to take 
advantage of the accumulation of knowledge about the 
presence, or absence, of the signal of interest. The 
SPRT, on the other hand, is not designed to take advan- 
tage of trends and one contrary observation is sufficient 
to totally disrupt a trend towards one or the other of 


the decision thresholds. 


IX. APPLICATIONS 


In the preceding discussion of the development and application 


of an adaptive decision process, the emphasis has been on the appli- 


cation of an adaptive procedure employing multiple observations to 


the special problem of optimizing electromagnetic signal detection. 


In addition to that useful application, the adaptive decision model, 


which relies heavily on a learning process, may be used to study 


other, more general, situations in which multiple observations are 


employed in formulating a detection decision. 


Multiple observations are typically encounterered in two types 


of situations: 


The first is the generalization of the situation discussed 


in this thesis; the situation in which observations are 


ou 


accumulated and the total weight of the evidence is used 
as the basis for a decision regarding the presence or 
absence of a useful signal. 

2. The second is the situation in which a decision is made 
based on multiple, independent observations. The 
detection decision rule usually employed is that a useful 
Signal is present if any one of the multiple observations 
indicates the presence of a useful signal. 

As an example of the application of the adaptive decision process 
developed in this thesis we will consider two situations in which 
humans act as signal detectors. The first situation is a straight- 
forward comparison of multiple, independent observers to a multi- 
channel receiver; the second is an example of the recursive learning 


process acting against detection. 


A. MULTIPLE OBSERVERS 

A,.common practice in practical detection problems is to use a 
team of observers who are to act independently and attempt to detect 
some signal of interest. The rationale for this practice is that 
the group effort is expected to improve the chances of detecting the 
signal of interest. For example, if two independent observers have 
an individual probability of detection D = 0.5, then the probability 
that one or the other or both will detect the signal is 0.75. 

Green and Swets [4, p. 248] discuss psychometric studies conducted 
to test whether or.not teams of observers would show this degree of 
improvement in detection capabilities. The typical finding in the 


studies was that if a gain in detection capability was made it was 


Ze 


not significant and further that an increase in the proportion of 
false alarms was experienced when the size of the team increased. 
Recalling the relation for the threshold signal-to-noise ratio 
for a multichannel receiver and rearranging terms, we have a rela- 
tion between detection parameters which is seen to apply to the 


team situation; i.e., 





ln LC 
F 1lnM 
Hue = “gies €: 
” ln - 1 1 
D aie 


where M is the number of observers on the team. We see that the 
larger the team gets, the larger the value of F which must be ac- 
cepted if the threshold signal-to-noise ratio is fixed and the 
detection probability (D) remains constant. If it were possible 
to hold F at a fixed value while M is increased, the model 
predicts that D would decrease if the signal-to-noise ratio is 
fixed. 

A possible solution to the false alarm problem is to replace 
a team of observers by a single observer with the capability of 
employing the adaptive decision process. This action would have 
the benefits shown for the adaptive receiver when it replaced the 
multichannel receiver, if the human observer is at least as pre- 
dictably "optimum" as he is predictabley "faulty". Alternatively 
the team could report to a decision maker who would be guided by the 


adaptive decision procedures. 


B. VIGILANCE 
The adaptive decision process model may also be applied to the 


detection problem characterized by extended periods of observation 
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during which signals can occur at any time without warning and with 

no predictive spacing between signals. This problem is referred to 

as the "vigilance" problem. In this type of signal detection environ- 
ment there is a known deterioration in detection capability as the 
observation period proceeds. 

The effect in these situations is as if the recursive learning 
process were being reversed. That is, the span (channels) of 
attention widens and the learning process may be considered to be 
strengthening an a priori opinion that no signal will be encountered. 
Green and Swets [4, p. 332] discuss the vigilance problem and it is 
again interesting to note that human performance seems to be follow- 
ing the characteristics of an adaptive receiver model. 

Limited studies on the vigilance problem indicate that the 
probability of detection decreases over time; interestingly, the 
false alarm probability has also been observed to decrease. Looking 


again at the relation for 4 we see that as the span of attention 


M? 
widens, the value of the term LnM/1 ne tends to increase. If a 
fixed value of Uy is assumed, the model predicts that D must 
decrease to maintain the equality of the relationship; further, the 
term “Ing/ Ine Suggests that if some directly proportional relacions 
ship were to exist between F and D then F would also decrease. 
A bcs sys solution to the vigilance problem is suggested by the 
recursive learning feature of the adaptive receiver. To apply this 
solution it must be assumed that the probability of detection (D) 
by a human observer is maintained at an acceptable level by focusing 


the observer's attention. Then, since the recursive learning process 


is strongly influenced by the likelihood that a useful signal is 
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present during the scan across the signal environment, it may be 
possible to focus attention by introducing dummy useful signals 


into the detection process. 


X. CONCLUSION 


When multiple observations are available, or are required, for 
use in the solution of a detection problem, the optimum utilization 
of these observations is through an adaptive decision process. In 
comparison to a simple detection process based on single independent 
observations, the adaptive decision process enables the observer 
to make a detection decision with the same level of detection error 
at a smaller signal-to-noise ratio (u) or conversely for a fixedu 
and fixed false alarm probability a higher probability of correct 
detection is possible through the adaptive process. 

The adaptive decision process is limited to signals of long 
duration due to the nature of the learning process used in this 
decision process. A procedure for computing the expected length 
of the decision process is developed. Based on this expected 
length of time to complete the decision process, the observer may 
evaluate the suitability of employing a relatively lengthy decision 
process with optimum properties to solve a detection problem. 

Lastly, the learning cycle used in the adaptive decision process 
Suggests that the model of an adaptive decision process may be used 
to predict the behavior of human observers performing signal detec- 
tion functions. Two such situations were discussed and it was 
shown that the adaptive decision process model does in fact lend 


itself to analyzing the behavior of human observers. 
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APPENDIX A: DERIVATION OF RECURSIVE FORM 


When the input signal f (t) is being examined by the detector, 


keh 


the signals Eis fo: see EL have already been examined. The Bayes 


optimum use of the prior inputs f1> fo» wee. fd is 


Can CE ee "fe A =e [LCF 0) ERGs 


cal _ 
where 

P(t) =7oltted, | ac) + etre cand 
the useful portion m(t,a,T,6) consists of a counting parameter, 
such as time, t; known parameters a; unknown parameters T which are 
measured upon detection; and unknown parameters 8 which are not 
measured. The purpose of examining f(t) is to learn the nature 


of T , for example to find the frequency on which a radio signal 


of known characteristics is being transmitted. 


Consider the probability density aT Ae 2? "**,f,). By the 
Bayes formula, it may be expressed as 
f 
PTE, 6f 7 ah (1) 
Pie, Cai sEgseees OP ala pe Loewe) 
PC giao? ai 


Under the assumption that each f. is independent of all other «i 


we may further state that 


mG |i or ee) ake ee 
Expressing Gl) as a compound event gives 


1 ae| righ eee + Gise o> in jae) 


where Py is the a priori probability that 
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f(t) = m(t) + n(t) 
and 1-p,; is the a priori probability that 
F(t) = n(t) 


Next, after factoring p P(E, In(t)) we have 


1-p, 
EKER IE > p,P(£, [n(t)) Cam ) a 5 (2) 


Next, by integrating equation (1) over all possible values of T 
we get 


EG SNE) irwieians ) = PENCE, | DIENON CA Epis ii AT ; 


k=i 
which may be factored to give 


lf. .£ or? ae, ss 


P(& le Ys 


k 


I-p, 
sl N20 i ii is ar ac om,» (3) 


After dividing (2) by (3) and cancelling common terms, we get 


PAC | Gave aif RS 


icaiaaiialaa 


T(r ee 
alg ni), . 
IBEGE eet Or 2 Arcee ; »f, dT + e 


ect 2 


ein 


The recursive nature of this relation is more readily seen by de- 
fining two new quantities, 


Ewes BROT) | ioe -,£,) ‘and 


igi 


ee ee) = oe, _ cyan 


Now the expression for P (T) may be rewritten as 


ea fal) + a 


P(t) =P, (tT) ——— 
k ee a (omen 


Py 
Py 


bay 


APPENDIX B: EXPECTED NUMBER OF OBSERVATIONS 


In the sequential probability ratio test, the expected number of 


observations (N) is 


oc 


E(N) = ) mP (m|T) , where 
m=1 
T is the unknown parameter of interest. It is convenient to 


introduce a variable a which is defined as 


£(x,|T,) 


Z,=1 


: n ,» where 
j — ‘pee, 


Ty is the state in which the unknown parameter is present, TS 
the state in which it is absent and to make use of the result, 


proved in [4], that 
N 
E{ ) Z.} = E(N)E(Z) 
j=l 7 


Then provided E(Z) # 0, we can find E(N). For this purpose we 


may write 


ees a 


N 
Z,|4. Bi ine lei P(d,) ; 


N 
El athe, aero 
re! iJ 


j 


where d. is the decision made in the event T is not present 
and ds is the decision made in the event T is present. If the 
decision d is made, this implies 
Nei N 
) Le? alan : » and ) ZL, =—ln : ' 
j=1 2 j=1 2 


Now assuming that no single bs is likely to dominate in the sum 


we may say 
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N 
E( } 


~ F 
Z.|d.) ~ In 5 ; 


1 


and similarly 


N 
~ 1-F 
E( ) Z,|d,) ~ ln =—— 
Fel 7% CUS 1-D 
After substituting, we then obtain 
P F 1-F 
BCD Zz.) = P(d.) In5 +P(d;) Ing 


ie 


from which the expected number of observations is seen to be 


F 1-F 
ace ip aelcrteat te (Glge| 0) Ele 


E(N) = E(Z) 
Since the probability is 1 that a decision is reached regarding 
the state of the unknown parameter T . 

As an example of the computation technique for E(N) consider 
a success or failure situation. Let T be the unknown fraction 


of failures in a sample of size N. Some action is considered 


)  aieiesT.. 


worthwhile (d_) it oes tT) and not worthwhile (d 1 


1 


If T <4 < qT) it is not important which decision is reached. 


The expression for E(Z) is gotten from 
X 1-X 
£(X|T,) i OER D 


Be is = la ———_——— _, 
£(x|T.) 7 a -t 


where X is the result of an inspection. Expanding the expression 


for Z gives 


Z= 1n T-1 ee wleny ? (ot)? which yields 
oO O 1 
1-T tT Gl=T -) 
a i 1 O 
E(Z) = In 7=y- + In ? G-T)”? 
O oO 1 
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when X is a defective. We now have 


F 1-F 
P(d|7) ina P(d, |7) ree 


EQ = IST C= 
1-T T (1-T,) 
oO O i 


lies l= f=) leand noting thae P(d_|T) =D and P(d,|T) =1-D, 


E(N) may abe simplified as follows, 


Tine al 
D 1-F 
Sg 
1 
1-1 
O 





ln 
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